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We formulate the generalized master equation for a class of continuous time random walks in the 
presence of a prescribed deterministic evolution between successive transitions. This formulation is 
exemplified by means of an advection-diffusion and a jump-diffusion scheme. Based on this master 
equation, we also derive reaction-diffusion equations for subdiffusive chemical species, using a mean 
field approximation. 
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Introduction. While transport in equilibrium systems 
occurs due to Brownian motion of the microscopic parti- 
cles following Fick's law, systems far from equilibrium of- 
ten show anomalous - i.e., non-Fickian and non-Gaussian 
- diffusion P, 0, Q. Here, the mean square displace- 
ment of a particle is given by a power law {x'^{t)) cx t" 
with a ^ 1. As a model of such anomalous behavior the 
Continuous Time Random Walk (CTRW) introduced by 
MontroU and Weiss in 1965 [4] and extended by Scher 
and MontroU to explain anomalous diffusion 5] has at- 
tracted much attention during the last few decades. The 
Scher-MontroU CTRW process corresponds to the situa- 
tion in which a particle (walker) is trapped on a site for a 
time T distributed with a power-law probability density 
W(t), and then makes a jump to another site. In between 
the jumps it neither moves, nor changes its identity, i.e. 
does not exhibit any dynamics of its own. The proba- 
bility distribution of walker's positions is determined by 
a generalized master equation which, under certain 
assumptions, takes the form of a diffusion equation with 
a time memory m. Even this simple model exhibits ex- 
tremely interestiiig properties connected with its intrinsic 
non-stationarity 7] and is still under extensive investiga- 
tion both theoretically and experimentally. 

In many situations, however, the system undergoes ad- 
ditional, internal dynamics also during waiting periods, 
due e.g. to a deterministic drift generated by an exter- 
nal force or due to chemical reactions among the diffusing 
particles. The purpose of the present Letter is to perform 
a treatment of such processes based on the derivation 
of a generalized master equation. We shall argue that, 
generally, these types of stochastic processes can not be 
captured by a subordination procedure along the lines of 
Fogedby Q . Our approach will allow us to formulate sub- 
diffusive reaction diffusion equations, which are of utmost 
importance for pattern formation in biological systems, 
due to the ubiguity of subdiffusive transport in biological 
systems (see e.g. Ref.fisj and references therein). 



Our treatment extends earlier work of Shlesinger et al. 
P on Levy Walks, which have been developped for the 
description of particle transport in chaotic and turbulent 
flows, the work of Metzler et al. [l^ on passively trans- 
ported particles in flows undergoing jumps with respect 
to the moving fluid and the work of Eliazar and Klafter 
[3] on the behaviour of overdamped particles exposed to 
random impacts, a special case of a shot noise situation. 

Fogedby 's subordination procedure. Generalized mas- 
ter (or Fokker-Planck) equations can be obtained in a 
straightforward manner by the method of subordination 
proposed by Fogedby [1]. Here, one considers a Markov 
process x{s) for a variable x depending on an internal 
(operational) time variable s. The corresponding proba- 
bility distribution f{x,s) obeys the Fokker-Planck equa- 
tion 
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where the Fokker-Planck operator Lpp is defined, e.g., 
in Ref. A related stochastic process y{t) = x{s{t)) is 
created by a time transformation s(t) which is assumed 
to be an independent random process with non-negative 
increments. It can be shown that the probability distri- 
bution of the process y(t), f{y,t), obeys a generalized 
Fokker-Planck equation, 

^/(y, t) - dt' Q{t - t') LFpfiy, t') , (2) 

whose solution reads f{y,t) = p{s,t) fo{y, s) ds 0]. 
In particular, it was shown that the quantity p{s,t) is 
the probability distribution of the process s(t) which is 
related to the kernel Q{t) by the relation 
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The choice Q{t — t') oc {t — t'Y ^ leads to fractional equa- 
tions [l| . Independently of the work by Fogedby, one of us 
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(I.S.) arrived at a similar conclusion for a much broader 
class of stochastic processes and clarified the meaning of 
the kernel Q{t-t') 

Examples of generalized master equations. Due to var- 
ious applications briefly mentioned above, the case of 
anomalous diffusion in the presence of an additional de- 
terministic process is of significant interest. However, 
Fogedby's approach can only be extended to this situa- 
tion in a straightforward manner if the deterministic dy- 
namics depends on the internal time s, not on the physi- 
cal time t. In the latter case one expects a quite different 
behaviour, and the derivation of a respective generalized 
Fokker-Planck equation - which is the main goal of the 
present Letter - turns out to be somewhat involved. Be- 
fore we address this issue in a general way, it is useful to 
first look at two concrete examples. 

In the first one, we consider a particle with coordi- 
nate q which is advected with a constant velocity v and 
subjected to transitions occuring at randomly distributed 
time intervals. The resulting generalized Fokker-Planck 
equation reads 



d_ 

dt 
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/q2 
dt'Q{t-t')—f{q-v{t-t'),t'). 

(4) 

In this context, we would like to point out the occurrence 
of a retardation effect in the diffusion term (cp. Refs.fT^. 
[l6l |) which is due to the advective force acting in real 
time on the anomalously diffusing particle. The above 
equation can be solved by the ansatz /(g, t) ~ F{q—vt, t). 
The probability distribution is then governed by 



dt' Q{t 



(5) 



with ^ = q — vt. Thus, in the present case, a transition 
to a co-moving reference frame leads to a conventional 
CTRW for the variable ^, in contrast to the behaviour 
for a subordinated process described by Eq. Similar 
arguments have been given in Ref. However, the 

generalized Fokker-Planck equation proposed therein is 
only valid to order . 

Let us now proceed to our second example. Here, 
we consider the motion of an overdamped particle (g = 
—jq), subjected to random transitions with a suitably 
defined waiting time distribution W{t). The evolution 
equation for the probability distribution f{q,t) describ- 
ing such a process takes the form 



(6) 
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Using this equation, we can derive an expression for the 
moments of this process to arbitrary order - in the limit 
of long times. Considering symmetric initial conditions 
one obtains for the moments of even order the rather 
strange behaviour (g^'^(t)) « Q{t). This behaviour differs 



from the one obtained for the subordinated case, in which 
the moments tend to constants. 

Derivation of a generalized master equation. Having 
considered two specific examples, we now describe the 
derivation of a generalized master equation for the class 
of processes under consideration. We assume that the 
variable q undergoes a purely deterministic (or a Marko- 
vian random) process which is characterized by the tran- 
sition probability (or propagator) p{q, q';t — t'). For the 
two examples considered above, we have, respectively, 
piq, q', t-t') = 6{q~q' - vit - t')) and p{q, q' , t - t') ^ 

S (^q — q'e^'^^*"* . However, the considered class also 

includes diffusion processes described by a Fokker-Planck 
operator. We further assume that the variable q under- 
goes sudden transitions from state q to state q' after time 
intervals r which are characterized by a waiting time dis- 
tribution W{t). Let us denote the transition probability 
from state q' to state q by F{q,q'). Then the proba- 
bility that such a jump between q and q' occurs in the 
time interval r is just F{q, q') W{t). Factorization of this 
quantity demonstrates that waiting times and transitions 
are statistically independent which is characteristic for 
decoupled CTRWs. 

As usual in the theory of CTRWs, the next step is to 
introduce the probability density for having arrived at 
times t' at an infinitesimal interval close to the position 
q' shortly after a jump. The respective quantity shall be 
denoted by r]{q',t'). The probability density of arriving 
at q at time t after another jump is then given by 



dt' / dq" / dq' F{q, q") W{t - t') 



X p{q",<^,t^t'),^{q',t')+5{t)f{q,Q). (7) 



Here, it has been taken into account that the system 
evolves after the first jump according to the process de- 
scribed by the propagator p{q" ^ q',t — t'), performing an- 
other jump from q" to q at time t. The probability den- 
sity f{q, t) related to the probability for finding a particle 
in the interval dq close to q is then given by 



fiq,t)= / dt' 
Jo 



dq'piq,q',t~t')wit-t')7j{q',t'). (8) 



After having arrived after the jump at time t' in the 
interval close to q' , the position of the particle changes 
according to the propagator p from q' to q. The quantity 
w(t — t') is the probability that no jump occurs in the 
time interval t — t' . It is related to the quantity W{t — t') 
according to 



w{t ~t') = l- dr 
Jo 



W{t). 



(9) 



The operator representation p{q,q',t — t') = 
^^L{t-t )}^^^, of the propagator p{q,q',t — t') allows for 
the determination of the Laplace transformed equations 

f(q,\)^w{\-L)T^{q,X) (10) 
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and 



rj{q,X)^ f{q,0)+ / dq'F{q,q')W{X-L)rj{q',\). (11) 



Here, the Laplace transforms of f{q,t), w{t), and W{t) 
are denoted, respectively, by /(g. A), w{X), and W{\). 
Combining both relationships, we arrive at the general- 
ized master equation for the process under consideration: 



d_ 

di 



f{q,t)= / dt'Q{t-t') 



(12) 



Here, we have introduced the kernel Q{t — t') which is 
defined by its Laplace transform 



X / dq'[Fiq,q')-Siq-q')] e^'*-*'' /(?', 



QW 



XWjX) 
1 - WiX) 



(13) 



For example, an exponential waiting time distribution 
W{t) = Le"^* leads to the kernel Q{t) = S{t). The 
representation of Q{t) in terms of the waiting time is 
necessary in order to obtain generalized master equations 
which define a nonnegative probability density /(q, t) for 
all times t [11]. 

At this point, it is useful to recall that, allowing only 
for nearby jumps, the transition probability F{q,q') in 
the master equation yields a generalized Fokker-Planck 
equation [17]. In our case, it is of the form: 



d_ 

dt 



f{q,t) 



dt'LFpQ{t-t')e 



L(t-t') 



(14) 

Here, the two operators L and Lpp arise. The Fokker- 
Planck operator ipp is connected with the transition 
probability F{q, q') of the time-random sudden jumps 
|17| , whereas the operator L is connected with the propa- 
gator p[q, q' , t, t') and describes the continuously evolving 
process. This is the desired Fokker-Planck-type equation 
for the class of stochastic processes under consideration 
- a key result of the present paper, representing a non- 
trivial generalization of Eq. ^ with the operator L - 
describing the time evolution of the system between suc- 
cessive jumps - entering on both sides of the equation. 

Analytic solutions. At first glance, Eq. (fT4)) appears to 
be rather complicated, maybe not analytically tractable. 
However, as the above examples show, analytical solu- 
tions are indeed possible. In this context, we would like 
to briefly mention the following strategy to solve this 
generalized Fokker-Planck equation. It turns out to be 
convenient to switch to a kind of interaction picture by 
employing the ansatz 



/(g,t)-e^*5(g,i) 



(15) 



Then, the resulting problem to be solved is 

^5(g, t) = e"^*L^^pe^* ^ dt' Q{t - t') g{q, t') . (16) 



Provided the two Fokker-Planck operators L and Lpp 
commute, we (only) have to solve the simpler problem 



d f* 

gldil^t) = Lpp J dt' 



Q{t-t')g{q,t'). (17) 



Comparing this result with the Fokker-Planck equation 
0, it is evident that g{q,t) describes a subordinated 
process. 

The first of the above mentioned examples falls into 
this catagory. As a further example, we would like to 
consider the two operators L = Qi-§^ and Lpp — Qo-§^ 
describing pure diffusion interrupted by randomly dis- 
tributed sudden transitions, i.e., a jump-diffusion pro- 
cess. The corresponding probability distribution takes 
the form 



dsp{s, t) exp 



q- 



2{Qos + Qit) 



(18) 



Calculating the even moments we find that their long 
term behaviour is dominated by the scaling behaviour 
{q{t)^'') (X t'^. The additional jumps result in subdomi- 
nated scalings. 

Subdiffusive reaction- diffusion equations. The master 
equation just derived can also be used to obtain reaction- 
subdiffusion equations - which happens to be a partic- 
ularly interesting application. The subdiffusive trans- 
port is modeled by the introduction of a random wait- 
ing times between the jumps of particles. The reaction 
among the chemical species evolves however continuously 
in time, changing the concentrations also between the 
jumps. Our derivation starts from extending the proce- 
dure leading to Eq. (fT^ to multiple dimensions, leading 
to a master equation for a multi-dimensional state vector, 
and the reaction-subdiffusion equations are then derived 
along the lines of the derivation of the reaction-diffusion 
equations from the usual Fokker-Planck equations. 

We partition real space into small compartments la- 
beled by the index i and consider TV different chemical 
species (labelled by a = 1, ..,N) which locally react ac- 
cording to the deterministic reaction kinetics 



(Ca,z) 



(19) 



Further, we allow for diffusive transitions between neigh- 
bouring cells. For the sake of simplicity, we assume 
that the transitions of all particles occur simultaneously 
("global update") at random times, characterized by the 
waiting time distribution W{t). The situations with in- 
dependent particle jumps ("local update") are also treat- 
able but lead to considerably more complicated calcula- 
tions. Lumping all concentrations Ca^i into the state vec- 
tor c, we can formulate the generalized master equation: 



-/(c,i) = __R(c)/(c,<)+ dt'Q{t-t' 



)(20) 
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Here the function G(c', t—t') is the solution of the kinetic 
equation (fTO|) with the initial condition G(c',0) = c'. 

The desired subdiffusive reaction-diffusion equation is 
an evolution equation for the mean value of the quantity 
c, C = / dcc/(c,t). It reads 

^C = y R(c)/(c,t)+y dt'Q{t-t') 

x[ J dcdc' cF{c,G{c',t-t'))f{c',t') 

- j dc'G{c',t-t'))f{c',t')]- (21) 

The mean field approximation J dc H{c) f{c,t) « H{C) 
leads then to a closed equation for the mean concentra- 
tions. Allowing only for nearest-neighbour transitions, 
we obtain the reaction-subdiffusion equation 

^C(x,t) = R(C(x,i)) (22) 

+ DA^ f dt'Q{t-t')G{C{^,t'),t-t') . 
Jq 

There have been several attempts to establish reaction- 
diffusion equations for subdiffusive chemical species (see 
[TqI and references therein). Ad hoc formulations can 
be obtained from Eq. by replacing G{C{k, t'), t - t') 
with C(x, t'). However, such equations show serious in- 
consistencies; in some cases, even mass conservation is 
violated [l^. The correct way to proceed was discussed 
in [Tgj for a special example of a linear bimolecular reac- 
tion scheme A ^ B. This case is contained in our gen- 
eral subdiffusive reaction-diffusion equation as follows. If 
we take the reaction rates R = MC to be linear in C, 
we obtain G (C(x, <'),*- = e^^(*-*')C(x, i')- For a 
two-component vector C(x, t) we end up directly with 



the system considered in [19|. Since the particles in this 
scheme do not interact, the global update assumption 
leads to the same results as the independent particle mo- 
tion considered in Ref . [l9j . An important application 
is the treatment of radiaoctive decay in flows through 
porous media [20l |. 

Finally, as a nonlinear example, we consider the subd- 
iffusive Fisher-Kolmogorov-Petrovskii-Piskunov (FKPP) 
equation, which has been proposed as a model equation 
for the propagation of favorable gene in a population [2^ . 
The diffusive version of the FKPP equation is one of the 
basic equations for the investigation of reaction fronts in 
nonlinear reaction kinetics. Our subdiffusive version for 
the A -1- A ^ A reaction reads 

^C{x,t)^C{x,t){\-C{x,t)) (23) 

^d^ Jo ^^*^^> [i_e-(*-*')]C(x,i') + e-(*-*') ■ 

Note the emergence of a nonlinear diffusion term in addi- 
tion to a temporal memory. We stress that the equation 
for a reversible reaction under global update differs from 
the one obtained in Ref.[23| for the locally updated irre- 
versible A -|- B — > 2B reaction scheme. 

Summary. We have considered stochastic processes 
which are partly generated by Markovian processes and 
which, additionally, are subjected to the impact of fluc- 
tuations randomly occuring in time. These impacts are 
treated in the framework of continuous time random walk 
processes by a waiting time distribution. Wc have de- 
rived the generalized master equation for this class of 
processes and have been able to formulate subdiffusive 
reaction-diffusion systems also for nonlinear reaction ki- 
netics, which are of relevance for pattern formation in 
biological systems. 
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